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ABSTRACT 


It is unclear what impact presence has on a virtual environment’s (VE) ability to enhance 
learning and performance. Currently, there are many theories and conjectures about the effects of 
presence in VEs. To better the effectiveness of VEs, it is imperative that we determine the impact, 
both positive and negative, of presence on our ability to perform in VEs. Therefore, we must study 
how presence affects a person’ ability to acquire skills and knowledge. This must include our 
ability to navigate and perform spatial tasks as well as any other aspect of the real world that may 
be represented by a VE. 

To begin understanding how presence affects performance, forty individuals participated in 
an experiment to determine how presence affects the ability to acquire spatial knowledge in a VE. 
The purpose of the experiment was to determine if the level of presence in a VE increased or 
decreased a person’s ability to acquire spatial knowledge, to include landmark recognition, 
procedural knowledge, and survey knowledge. Each participant received one of the following VE 
treatments: (1) No Sound, (2) Verbal cues with topical information, (3) Verbal cues with spatial 
information, or (4) A combination of both topical and spatial information. They were administered 
a series of spatial tests. Finally, they were given a presence questionnaire to measure their self- 
assessed level of presence. 

The results indicate that as the level of presence in the VE varies, there is no effect on a 
person’s ability to acquire spatial knowledge. A person’s spatial performance is more likely the 
result of their innate spatial abilities and visual memory. Additionally, including non-spatialized 
sound in a VE increased the reported level of presence by 15.1 percent. When that sound was 
exclusively related to the primary task the level of presence increased by 17 percent. Finally, the 
inclusion of non-spatialized sound has no affect on the ability to perform spatial tasks. 
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I. 


INTRODUCTION 


Over the past several years, virtual environments (VE) have become widely accepted as a 
means of training. The Department of Defense has invested billions in its attempt to save dollars 
as well as improve training methods for its members. Every year the parade of new and 
innovative VEs grows. However, despite this increasing acceptance of this new technology, 
there remain many aspects of VEs which have received little or no attention. 

A common underlying assumption has been that VEs are a suitable means or replacement 
for actual training. This attitude continues to persist even as research demonstrates the potential 
negative aspects of some VEs. Questions about the suitability of VEs still remain. For example, 
while conducting a land navigation experiment, Goerger [GOER 98] found that subjects using 
only a map gained more spatial knowledge of a one km piece of terrain than did subjects using 
the map and a VE. It is becoming increasingly imperative that the limitations of VEs as tr ainin g 
aids be examined in depth. 

At this time, the critical components of VEs that are important to training effectiveness 
are not understood. The overarching goal is to determine what these components are and how 
each one relates to increased effectiveness of VE training. This will lead to the development of 
VEs that enhance training as well as eliminate those VEs that inhibit, or are not an effective 
means of, training and learning. 

A. PRESENCE IN VIRTUAL ENVIRONMENTS 

One aspect of the subjective experience in VE systems that has received 
considerable attention is the extent to which the human operator loses his 
awareness of being present at the site of the interface and instead feels present in 
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the artificial environment. This feature is often referred to under the headings of 
tele-presence, virtual presence, or synthetic presence and is dependant on many 
factors, including (but not limited to) the extent to which the interface is 
transparent and attenuates stimulation from the immediate environment, as well 
as the amounts and kinds of interaction that take place in the artificial 
environment. 

[DURL95J 

Attempting to identify all the critical components of VEs is difficult, however there are 
certain components that are almost universally accepted. One of these components is presence. 
Presence can be described as the psychological sense of “being there.” In other words, it is the 
ability to be in a place (VE) other than where one’s body is physically located. What makes VEs 
so unique is not only the ability to create these worlds so that we can visit and interact with them 
in ways not possible only a few years ago, but also the phenomenon of presence. Presence is 
often considered a central goal of VEs, perhaps a defining feature [STER 92]. This sense of 
presence can occur while reading a book or watching television, however these media do not 
stimulate the senses in the same manner as a VE.~ VE technology enables a direct first-person 
experience to a much greater degree than any previous medium [DODS 98]. 

One of the major problems when studying presence is the myriad of definitions that exist 
as well as the subjective nature of its measurement. Although few would argue that presence 
does not exist, it is loosely defined. This fact often leads researchers to proceed in the absence of 
a universal definition. This has resulted in even greater ambiguity as to what presence actually is 
as well as what presence is not. Often the terms presence and immersion are used 
interchangeably when discussing the utihty of VEs. However, immersion relates to the 
technologies used to create VEs while presence involves the cognitive response or sense of 
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“being there” [SLAT 97]. There is httle hard evidence to define the relationship between the two, 
but it would seem obvious that some relationship must exist. Past research has shown that 
technological factors that have affected the level of immersion also have had an affect on the 
level of presence. What is now needed is a systematic research effort designed to gain an 
understanding of the cognitive and technological factors that determine the sense of presence as 
well as the influence of presence on general learning, task performance, and knowledge 
acquisition within VEs (Figure 1). 



Figure 1: Influencing Factors of Presence and Immersion 

The goal of this research is not to develop a clear and unambiguous definition of presence 
nor to establish a comprehensive relationship with iimnersion, but rather towards an 
understanding of the effects of presence as well as its components and to relate these to 
performance in VEs. If this can successfully be done, a body of knowledge will then exist for 
the design of VEs that effectively use presence for training or whatever their intended purpose. 
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B. PRESENCE AND PERFORMANCE 


The phenomenon of presence is being used as the basis for predicting new gains in the 
effectiveness of learning, comprehension, performance, and transfer of training [SHER 92]. 
These claims are consistently made despite a lack of evidence. This comes from the belief that 
training in a VE provides convincing practice for reactions that occur in the real environment. 
Therefore, if one believes they are present in an alternate environment or one experiences a 
higher sense of presence in the VE, the more likely they are to respond to situations in the VE in 
a manner similar to how they would respond to the same situation if encountered in the real 
world. However, this is purely conjecture. 

The effects of presence on performance are not fully understood in any way nor has a 
correlation between presence and performance been established. Although the idea that presence 
will result in better performance seems logical, it is likely that it only plays a supporting role that 
only enhances performance in specific types of VEs or tasks. From military training to 
architectural design to surgical simulation, VEs are being used in various ways. From such 
diverse applications, it is easy to determine that presence likely affects performance to varying 
degrees among these VEs. Creating VEs that will enhance performance requires knowledge of 
the types of tasks that are improved with increasing levels of presence. 

In the past, traditional psychological explanations were used to describe behavior and 
performance in VEs. Rarely was the effect of presence measured or taken into account. When a 
subject performs poorly in a VE experience, is this due to the VE, the interface, or the fact that 
the user did not feel a significant level of presence? To begin answering this question, it is 
critical to examine presence as a function of performance of specific tasks within VEs. 
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One critical part of VEs involves the concept of “space” and in providing the user the 
ability to acquire spatial knowledge of that space. Lawson (1998) made several observations 
related to this while conducting his experiment, which was designed to develop a quantitative 
measurement of presence based on attention theory. These observations are quite relevant when 
discussing the effect presence has on performance. First, Lawson’s experiment positively 
correlated presence and sound, with sound being defined as non-spatialized verbal cues or 
ambient noise. These results are not surprising since involving more of a person’s sensory 
modalities should lead to a greater sense of presence. However, this leads to the question of what 
type of sound is required to increase the level of presence. Is it simply background noise such as 
that of a car’s engine or does it require semantic information such as instructions or verbal cues 
that direct the users attention to the VE? 

Second, those participants whose VE experience included sound reported conclusively 
that the visual aspects of the VE involved them more completely than the participants who did 
not receive sound. Further, the participants who received sound during their VE experience 
conclusively reported a higher sense of objects moving through space as well as a higher ability 
to examine objects more closely and from multiple viewpoints. Additionally, participants 
receiving sound believed their ability to control events within the VE was higher than those 
participants who did not receive sound, although in this case the results were inconclusive. The 
critical point is that both treatments provided exactly the same visual treatment and interface as 
well as no control over events within the VE. Why does the inclusion of sound result in this 
perception and what role does presence play in accounting for this perception? 

Third, Lawson presents anecdotal evidence to suggest that spatial awareness varied 
among treatments, although this was not fully investigated. It is logical to suggest that if users 
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feel more present within a VE, it is more likely that they will be spatially aware of that 
environment, at least in the same way we are spatially aware of the physical environment. 
Therefore, it is reasonable to suggest that presence must have played some role in participant’s 
spatial awareness. 

However, the presence or absence of sound, particularly non-spatial sound used by 
Lawson, does not obviously influence the ability to acquire spatial knowledge. Based on these 
two ideas, the following question arises. If including sound in a VE increases the reported level 
of presence, and increasing the level of presence increases the level of spatial awareness, does it 
follow that increasing sound leads to an increase in spatial awareness? Although this argument 
makes sense on the surface, it is counterintuitive to conclude that sound, in and of itself, would 
affect a person’s ability to acquire spatial knowledge, particularly when the sound is not 
spatialized nor does it contain spatial content. However, should this argument be proven, does 
the type of sound in the VE impact presence and thereby impact the ability to acquire spatial 
knowledge? 

Although Lawson’s data did not correlate presence and performance, namely spatial 
comprehension, it does provide an excellent starting point for examining the relationship 
between sound, presence, and spatial comprehension. This thesis will focus on the effect that 
non-spatialized sound (i.e. primarily verbal) has on presence and the ability to acquire spatial 
knowledge within a VE. 

C. RESEARCH OBJECTIVES 

The primary focus of this thesis is to determine if there exists a correlation between 
spatial conq)rehension and presence based on varying aural parameters. This thesis limits its 
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focus to one real-time VE. The levels of presence provided by varying aural display parameters 
are identified. To accomplish this goal, an experiment was conducted which will be described in 
detail later in this thesis. The following questions are examined to better understand the 
relationship between presence and the acquisition of spatial knowledge . 

- Do varying levels of presence affect the amount of spatial knowledge acquired in 
VEs? 

- Does the introduction of non-spatial sound cues increase the level of presence? 

- Does the type of sound cue, whether topical or spatial in nature, affect the level of 
presence? 

- What role does innate spatial ability play in the acquisition of spatial knowledge in 
VEs? 


D. THESIS ORGANIZATION 

This thesis is organized into the following chapters: 

- Chapter I: Introduction. This chapter provides a general framework for the thesis. It 
discusses the importance of evaluating presence and performance. Additionally, this 
chapter covers the thesis objectives and the reasons this research is being pursued. 

- Chapter II: Background. This chapter looks at both past and present work that are 
related to both presence and the acquisition of spatial knowledge. 

Chapter III: Approach. This chapter explains in detail how the measures for acquiring 
spatial knowledge were developed. In addition, it describes the variables that affect 
the level of presence and how that relates to the level of spatial knowledge acquired. 

- Chapter IV: Method. This chapter describes in detail the experiment and different 
treatments that were administered to each subject group. 

- Chapter V: Analysis. Included in this chapter are the results of the experiment in 
terms of the stated hypotheses. 

- Chapter VI: Conclusions and Recommendations. The chapter provides an overview 
of the experiment results as well as the importance of those results. Finally, it also 
provides recommendations for future work in this area of research. 

- Appendices: 

A. Raw Data 

B. Experiment Outline 

C. In-Briefing Script 
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D. Consent Forms 

E. Questionnaires 



n. BACKGROUND 


Many conjectures and ideas exist to suggest that an increase in presence is predictive of, 
or somehow related to, performance within a VE, in spite of the nonexistence of definitive 
evidence. The reason for this is that presence is a very subjective area of research and a formal 
definition has not yet been determined. Furthermore, presence is often confused with immersion. 
In general, research focuses on immersion (technology) and theories concerning presence are 
merely a byproduct of this research. Currently, there is no widely accepted definition of 
presence nor has a correlation with performance ever been established. 

Why is it important to define presence and determine its effects on performance? First, 
VE designers are continually developing new and innovative VEs that have extended the limits 
of VEs. With these new VEs, the ability to create a sense of presence for users seems to grow, 
yet no one understands the impact presence has on VE performance. If an understanding of 
presence existed along with its relationship to performance, the efforts of VE designers could be 
directed at enhancing presence to maximize VE performance, if a correlation does, in fact, exist. 
Today, most VE designers simply attempt to get maximum frame rates, better fidelity, and 
improve interfaces assuming that greater realism results in greater presence which results in 
improved performance. However, how these technological improvements affect presence goes 
unexamined. Perhaps these improvements are not necessary to improve performance. Perhaps 
presence has a value in and of itself, outside the scope of performance. These are issues 
demanding investigation. 

In order to better understand the concept of presence and the acquisition of spatial 
knowledge and how it can benefit the design of VEs, a brief background is presented in the 
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following areas: presence, spatial knowledge, and methods of measurement of spatial 
knowledge. 

A. PRESENCE 

Presence is generally defined as the subjective experience of being in one place when one 
is physically in another [WITM 98]. Presence implies that observers perceive their self¬ 
orientation and self-location with respect to the environment [PROT 94]. Since presence is a 
perception, it is extremely subjective by nature and difficult to quantify, however it is generally 
regarded as a defining characteristic of VEs. The Presence Questionnaire (PQ) developed by 
Witmer and Singer [WITM 98] does provide a means of measuring this subjective perception 
that users feel in a VE. The PQ is a self-assessment of the level of presence experienced in a VE. 

As stated earlier, defining presence is difficult due to its subjective nature. However, 
Heeter [HEET 92] has presented a framework for defining presence based on three dimensions 
of presence; personal, social, and environmental presence. 

1. Personal Presence 

Personal presence refers to the reasons that one feels like they are in another world. 
Personal presence is affected by seeing one’s hand in the VE or even experiencing a sense of 
deja vu. Research in this area largely focuses on identifying as many features of the VE that 
contribute to convincing someone that they are in another world. However, it must relate to the 
VE not the technology used to create that VE since that would be more related to immersion 
rather than presence. 
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2. Social Presence 


Social presence can be thought of as a subset of personal presence. Social presence deals 
with other beings that exist in the VE and their reaction to the user. They may be other humans 
or animated characters that interact with the user. What defines something as contributing to 
social presence is the fact that someone or something else appears to react to your being there. 
This perception allows one to more easily accept the fact that they too are there (in the VE). 

3. Environmental Presence 

Environmental presence is similar to social presence except that instead of someone else 
reacting to you, the environment itself reacts. For example, if the lights in a room turn on when 
you enter, or the door closes behind you after you have entered this would enhance 
environmental presence. Additionally, environmental presence is increased if the objects within 
the VE behave in a manner consistent with the real world. The ability to walk through walls 
would be thought to diminish the sense of environmental presence, although there may be 
benefits associated with this ability. 

What these three “dimensions” of presence have in common is that there is something 
that enables one to believe that they are in another place. The examples mentioned above are 
visual in nature, however they may likely be in the form of sound or touch. Further, they deal 
with the realism of the VE. Realism can be defined as how accurate the objects, events, and 
people are reproduced in the VE. If the VE is more accurately depicted (with respect to realism) 
then the level of presence should increase. 

These dimensions provide an excellent starting point to understanding the types of 
presence that occur within VEs. What is most interesting about these dimensions, and the 
literature as well, is that presence is almost universally explained firom an egocentric point of 
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view. Presence from an exocentric point of view is rarely discussed and little research exists that 
compares egocentric versus exocentric frames of reference in terms of presence. However, since 
the literature discusses the importance of realism as a factor for increasing levels of presence, 
egocentric frames of reference, which are more “real” than an exocentric frame of reference, can 
be thought of as producing higher levels of presence. 

B. IMPACT OF PRESENCE ON PERFORMANCE 

Presence frequently becomes an issue because it is thought to correlate with task 
performance, however there are many factors that alter the level of presence, thus attenpting to 
speculate its effects is difficult. Irregardless, there remains the question of how presence 
contributes to task performance in VEs. 

Presence is important because the greater the degree of presence, the greater the chance 
the participant will behave in a VE in a manner similar to their behavior in similar circumstances 
in everyday reality [SLAT 97]. From this, we can see the implications of studying presence. If 
presence creates behavior in a VE that we would expect in the real world, it follows that presence 
may also affect performance or the ability to learn in a VE consistent with that of the real world. 
If this were the case, it would enable developers of VEs to enhance learning based on the proven 
concepts of learning in the real world. 

Presence implies that observers perceive their self-orientation and self-location with 
respect to the environment [PROT 94]. Assuming this is the case, an argument can be made that 
acquiring egocentric spatial knowledge of an environment requires a sense of presence. In a VE, 
presence is closely linked to situational awareness. Prothero [PROT 94] suggests these are 
overlapping constructs. If one is situationally aware, then one should acquire spatial knowledge 
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of that environment. However, to date no relationship exists between presence and spatial 
knowledge acquisition. 

C. SPATIAL KNOWLEDGE 

There has been considerable research done on the psychological aspect of acquiring 
spatial knowledge. Spatial knowledge or spatial cognition is a mental representation of a real or 
virtual emvironment [WICK 97]. Thorndyke [THOR 80] breaks spatial knowledge down 
hierarchically into three levels. They are landmark knowledge, route knowledge, and survey 
knowledge (Figure 1). It should be pointed out that each level is not self-inclusive, but rather 
builds upon the knowledge gained at the previous levels [THOR 80]. To measure the amount of 
spatial knowledge acquired, all three must be taken into account. 



Figure 2: Thomdyke’s Hierarchical Model 
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1. Landmark Knowledge 

Landmark knowledge is static information about the visual details of a specific location 
[DARK 95]. This implies that measuring landmark knowledge is based on a person’s ability to 
recall objects they have seen, such as road intersections, terrain features, or buildings. Satalich 
[SATA 95] explains that objects become landmarks for two reasons: their distinctiveness and 
personal meaning. It is a visual task that largely depends on the capabilities of memory. 

The acquisition of landmark knowledge is gained from direct exposure to an 
environment, however past studies have demonstrated that video and photographs can also 
provide a person with landmark knowledge. Gale [GALE 90] found that the ability to identify 
landmarks was identical between those who physically explored an environment and those who 
were provided a video walk-through. This also suggests that landmark knowledge is gained 
from an egocentric frame of reference. Figure 3 depicts how landmark knowledge is mentally 
represented. 



Figure 3: Landmark Knowledge 


A person with landmark knowledge can recall any of the distinct features (X, Y, and Z) 
of this environment, but they would not be able to determine the relative position of these objects 
nor have the ability to navigate between them. For example, most people who have never visited 
New York City can easily identify the Statue of Liberty, the Empire State Building, and the 
Brooklyn Bridge, however if asked to navigate from one to the other or determine their relative 
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positions they would not be able to do so. To accomplish this task, higher levels of spatial 
knowledge are required. 

2. Route Knowledge 

Route Knowledge is defined as the procedural knowledge required to successfully 
traverse distances between origins and destinations [GOLL 91]. In addition, route knowledge is 
the ability to navigate successfully from one landmark to another on a known route, but not 
recognizing alternative routes [SATA 95]. Therefore, route knowledge connects landmark 
knowledge into a larger, more complex structure [GOLL 91] (Figure 4). 



Figure 4: Route Knowledge 

Route knowledge can be thought of as memorizing directions in an unfamiliar city. 
Therefore, route knowledge may be stored as a schema, again suggesting that the ability to 
acquire route knowledge is memory dependent. Route knowledge is based on approximating 
distances and landmark knowledge. As with landmark knowledge, acquiring route knowledge is 
dependent on visual memory. While forming route knowledge, images and landmarks are 
recalled [SATA 95]. Darken [DARK 95] defines route knowledge as a sequence of actions 
required to follow a specific route. Figure 4 demonstrates how route knowledge is used to 
navigate an environment. If a person has to navigate from position X to position Z, the person 
can only do so along the known route depicted by the solid lines. If, as in figure 5, the route 
from position X to position Y is blocked, a person with only route knowledge would not be able 
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to identify the alternate path from position X directly to position Z which is depicted by the 
dotted line. To accomplish this task, a higher level of spatial knowledge is required. 



Figure 5: Route Knowledge (with Alternate Route) 

3. Survey Knowledge 

Survey knowledge is the highest level of spatial knowledge [THOR 80]. Survey 
knowledge is map-like in nature [DARK 95]. It can be described in terms of route knowledge 
with the difference being that alternative routes can be identified. A distinguishing feature 
regarding survey knowledge is that it requires a person to think from an exocentric point of view, 
whereas landmark and procedural knowledge can be thought of from either an egocentric or 
exocentric viewpoint. Object location and inter-object distances are encoded in terms of an 
exocentric, fixed frame of reference which is significantly different from route knowledge which 
is defined as the sequence of actions required to follow a predetermined route [DARK 95]. 

Survey knowledge can be gained from map study or through extensive and repeated 
exposures to an environment [THOR 80]. Acquisition via repeated exp«.sures to an environment 
suggests that a person also has acquired landmark and procedural knowledge and used this 
knowledge as a building block to gain survey knowledge. Survey knowledge is demonstrated by 
an individual’s ability to identify known locations and distances between landmarks and having 


16 



the ability to devise new routes between these landmarks, even though the individual has never 
traveled the route between them [BANK 90], Figure 6 shows how a person with survey 
knowledge understands the environment. A person can navigate to any landmark as well as 
identify the relative position of any landmark in the environment regardless of the person’s 
relative position in that environment. 



Figure 6: Survey Knowledge 

4. Measuring Spatial Knowledge 

The study of human spatial cognition cannot be separated from a careful examination of 
the measures used to assess it [WALL 99]. There are many methods usd to study and evaluate 
spatial knowledge. This is, in large part, due to the fact that spatial behavior is so varied. 
Distance estimation tasks and landmark identification are both spatial tasks, however the ways 
one completes each of these tasks do vary. Clearly, the methods used to measure the various 
types of spatial knowledge must differ as well. 

Methods used to measure landmark knowledge are the most accepted and often used. 
The methods consist almost exclusively of landmark recognition and recall tests. The reason 
these tests are so well accepted is the fact that they are easily measured and quantified. Further, 
how one acquires landmark knowledge varies although the results do not. Gale [GALE 90] 
found that landmark recognition was identical between groups that physically explored an 
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environment or those that received a video walk-through. Other research has found that 
landmark identification could be accomplished via photographs. This indicates that one need not 
be present or even feel present in an environment to acquire landmark knowledge. 

Generally, route knowledge is measured via route replication tasks. Based on the number 
of wrong turns taken by a participant, the amount of route knowledge can be computed. 
However, there are many other tests used to measure route knowledge. They include route 
distance estimation tasks, map sketching tasks, verbal descriptions of routes, route recognition 
tasks, and landmark sequencing tasks. Although there are benefits for using any of these tasks, 
there are shortfalls. Map sketching tasks are generally limited by the artistic and motor skills of 
individuals. Therefore, it becomes difficult to determine if a person performs poorly due to the 
fact that httle route knowledge was acquired or simply that the person is unable to competently 
sketch a map. 

The same problems that exist for map sketching tasks also exist for using verbal 
descriptions to measure route knowledge. Landmark sequencing tasks are heavily weighted 
toward visual memory. If a person forgets a landmark, it can greatly affect the route regardless 
of the amount of route knowledge acquired. Additionally, unlike landmark knowledge, the 
means of providing information affect the acquisition of route knowledge. The field of view and 
the ability to selectively attend to the environment both affect the acquisition of route 
knowledge. Gale [GALE 90] conducted research that compared the amount of route knowledge 
between individuals who physically explored an environment and those who were provided a 
video walk-through. The video group performed much worse on the route knowledge tasks. The 
results were, in large part, due to the fact that the video group was unable to perform head 
rotations and unable to see objects outside their field of view. These problems must be 
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addressed in order to fully understand how route knowledge is encoded. Understandably, the 
methods for measuring route knowledge are less accepted than those used to measure landmark 
knowledge. 

Survey knowledge, like route knowledge, has many methods for measurement and even 
more shortcomings. Methods used to measure survey knowledge include analyzing map 
sketches, recognition tests, pointing tests, and Euclidean distance estimation tasks. Generally, 
the most accepted measures are pointing tasks and Euclidean distance estimation tasks. The 
Euclidean distance estimation task involves the subject providing distances between landmarks 
or between landmarks and oneself. The distance is measured “as the crow flies” or simply a 
straight-line measurement. Pointing tasks have the subject point in the direction of various 
landmarks in the environment that are outside the field of view or visually obstructed. The major 
difference between these tasks is the frame of reference. Pointing tasks are almost exclusively 
measured from an egocentric frame of reference while the Euclidean distance estimation task 
may be from either an egocentric or exocentric frame of reference. The major shortcoming with 
both of these tests is that they are largely dependent on a person’s spatial abilities. All measures 
of survey knowledge must take into account the innate spatial abilities of the subjects. This fact 
makes it difficult to determine if the results are due to the spatial abilities of the subjects or the 
lack of survey knowledge acquired. In addition, the pointing tasks have the added problem of 
forcing the individual to make mental rotations. Since survey knowledge is encoded in an 
exocentric frame of reference, individuals must convert this information into an egocentric frame 
of reference to complete the task. Mental rotations require a unique skill that greatly varies 
among individuals. This fact results in innate spatial abilities again playing a significant role in 
the amount of survey knowledge acquired. 
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III. 


APPROACH 


The purpose of this chapter is to explain the rationale used to arrive at the hypotheses for 
this thesis. The idea for this research was derived from the results of Lawson [LAWS 98], which 
found that including non-spatialized sound led to increased immersion and that as immersion 
increased the corresponding measure of presence also increased. Further, Lawson also suggests 
that there may exist a link between presence and performance; however, evidence for this was not 
presented in his research. It is the purpose of this thesis to examine this relationship by first 
determining if including various non-spatialized sounds can lead to greater levels of presence and 
then relate the level of presence to performance, which in this case will be the completion of a 
spatial task. This research question was arrived at via a circuitous route. This experiment takes the 
approach that if presence is positively correlated with performance of spatial tasks, and sound cues 
are shown to increase presence, then spatial performance can be correlated with sound cues. If this 
can be proven, then it seems likely that an associative relationship should exist between sound, 
presence and performance. However, a connection has yet to be made between performance on 
spatial tasks, such as navigation and presence. 

A. RELATING SOUND AND PRESENCE 

The literature suggests that performance on spatial orientation .>nd navigational tasks is 
likely to be enhanced if the perceived level of presence is increased. In other words, if we really 
felt like we were in a virtual world, performance on spatial tasks within that world should 
improve. Also, the past studies of Gilkey [GILK 95] and Hendrix [HEND 96] suggest that aural 
stimuli are necessary factors in increasing the level of presence in VEs. In addition, Lawson 
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[LAWS 98] found that including sound in his VE display lead to an increased level of 
engagement within that VE. 

Lawson [LAWS 98] conducted an experiment that clearly shows that the addition of 
sound increased the reported level of engagement as defined by focussed attention. After further 
evaluation of Lawson’s data, it can be concluded that the inclusion of sound also increases the 
reported level of presence (Figure 7). However, there does exist some ambiguity with this 
statement. 


Interaction Bar Plot for PRESENCE SCORE 
Effect: TREATMENT (Sound vs No Sound) 



NO SOUND SOUND 


Figure 7: Comparison of Sound Treatments as a Function of PQ Score 


The experiment in question used non-spatialized sound that included verbal information 
that was both semantic (topical) and spatial. The semantic component of sound included the 
sound of the vehicle’s engine and the radio as well as information provided via an automated 
recording. The spatial component was contained in the automated recording to include absolute 
as well as relative locations of landmarks within the VE. These sound components clearly 
increased the level of presence, which can be seen in Figure 7. However, it is unclear whether 
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both of these components were required to produce the feeling of prest ice or if only one of the 
components was required. 

Thus, the following concept was developed for this experiment. What effect does non- 
spatial, semantic sound have on presence as compared to sound that only includes spatial 
information? In addition, does including both the semantic sound and spatial sound components 
produce greater levels of presence? In other words, is the sum of the sound components greater 
than the individual parts as measured by presence? 

B. RELATING PRESENCE AND PERFORMANCE 

In reviewing the work of Lawson, the level of engagement increased when non- 
spatialized sound cues were introduced. When given a post-VE quiz, participants who received 
the sound treatment scored higher than those who did not receive sound cues. This quiz did not 
measure the ability to acquire spatial knowledge, since it was not the focus of his research, 
however the quiz did include questions that were spatial in nature. Examples of these questions 
include, but were not limited to, ‘What was directly across from the library?” and “Where did 
your trip begin?” However, few conclusions can be drawn from this data regarding the effect of 
presence on spatial awareness since it was not fully investigated. But since presence has been 
shown to correlate with the level of engagement [LAWS 98] and engagement resulted in 
participants being better able to answer questions that in some cases were spatial in nature, it is 
reasonable to assume that presence must play some role in participant’s spatial awareness. 
Based on this assumption, the experiment for this thesis was designed to measure performance of 
a spatial task. This will provide a means to determine if the level of presence is a predictor of 
performance of spatial tasks in VEs. 
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C. RELATING SOUND AND PERFORMANCE 

The previous ideas imply a further relationship. If improved performance can be 
correlated with increasing levels of presence, and presence was increased due to the inclusion of 
sound cues, then it follows that increasing sound should lead to an increase in spatial 
comprehension. Although this argument makes sense on the surface, it is illogical to conclude 
that sound, in and of itself, would affect a person’s ability to acquire spatial knowledge, 
particularly when the sound is not spatialized. 

Three dimensional (3D) spatialized sound in VEs can be described as sound that provides 
the listener with a sense of the location of a virtual sound source. For example, a 3D spatialized 
sound of an airplane will provide a sense that the sound is coming from overhead and will appear 
to the user to come from a particular location in the space outside the listener’s head. Spatialized 
sound has been found to increase the level of presence in VEs when compared to non-spatialized 
sound or no sound environment [HEND 96]. While this is valuable research, the relationship 
between presence and non-spatialized verbal cues was not examined in this experiment. Does 
the use of non-spatialized sound that includes spatial content increase presence? Also, what if 
the verbal cues only provide semantic information? Non-spatialized sound, regardless of 
whether or not it contains spatial content, is likely to be able to direct the user's attention to 
particular objects in a VE. If you are told that there is an airplane directly overhead, or if you 
hear that plane overhead, both should result in the user looking up. 

As asked earher, does the type of non-spatialized sound in the VE impact presence and 
thereby impact the ability to acquire spatial knowledge? To answer this question we need to 
identify components of sound and to determine their impact on presenc e and performance. For 
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this experiment it was determined that two major components of non-spatialized sound would be 
examined. The components were the semantic and spatial sound components. 

The semantic sound component can be described as those sounds that do not provide any 
spatial information or simple ambient noise. For this experiment, the sound of the vehicle’s 
engine and radio are considered ambient noise, while the verbal cues that provide topical 
information are considered to be the non-spatialized semantic sound component. Providing a 
participant with information about the age of a building, but not its location would be an 
example. A non-spatialized spatial sound component would be the absence of ambient noise and 
the inclusion of verbal cues that are specifically designed to provide the participant with spatial 
knowledge. An example would include providing the participant with information that a 
particular landmark is located on the northeast corner of the town. 

D. EXPECTED RESULTS 

The hypotheses of this thesis lead to the following prediction. Participants who 
experience high levels of presence will acquire more spatial knowledge than those who 
experience lower levels. Further, those who receive any sound cues will report experiencing 
higher levels of presence than those who receive no sound cues. However, among the sound 
treatments, those who receive semantic or topical sound information will report higher levels of 
presence than those who receive verbal cues containing only spatial content, while those who 
receive spatial information will perform better on all spatial tasks. Lastly, those who have a high 
level of innate spatial abilities will out perform those who do not, but among those of equal 
ability, the level of presence should be a determining factor of performance. 
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rV. METHOD 


A. EXPERIMENTAL DESIGN 

The experiment was a between group design with the sound condition being the 
independent variable. The sound treatments were (1) No Sound, (2) Verbal Cues with Semantic 
and Topical Information Only, (3) Verbal Cues with Spatial Information Only, and (4) Spatial 
and Semantic Information Combined. The semantic group received information that contained 
no spatial information such as “The Catholic church is the oldest building in Marsville” and 
contained non-spatialized sound that simulated the vehicle’s engine and radio. The spatial only 
group received information that only described spatial aspects of the VE. For instance, “The 
church on your left is located on the northeast comer of town, one block fi-om the hbrary.” 
Accordingly, the combined semantic and spatial group received a combination of the two 
treatments mentioned previously. 

The dependent variables included responses to questionnaires and a number of spatial 
knowledge measures. The two questionnaires used were the Presence Questionnaire (PQ) and 
the Immersive Tendency Questionnaire (ITQ). The ITQ measured the participant’s immersive 
tendencies to become involved prior to the VE treatment. The PQ was used to measure the 
subject’s sense of presence within the VE [WITM 98]. These questionnaires were used to 
determine the level of presence experienced by each subject. The questionnaires are self- 
assessments and therefore subjective by nature. 

The spatial knowledge measures were developed to be both egocentric and exocentric in 
nature. The egocentric measure is a pointing task. A map building exercise was used as the 
exocentric task. These tasks will be described in detail later in this chapter. 
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B. HYPOTHESIS 


The hypotheses for the experiment are as follows: 

- The level of presence in a VE will increase the amount of spatial knowledge acquired 
in a virtual environment 

- Given four different auditory treatments, individuals will experience a higher level of 
presence in a virtual environment given any sound cues compared to those who 
receive no sound cues. 

The sub-hypotheses for the experiment are as follows; 

- Those participants who receive verbal cues with spatial content will score higher on 
all spatial tasks as compared to those who receive no sound cues or only semantic 
sound cues. 

Those participants who score higher on the Building Memory Test will score higher 
on the Map Building Test (procedural and route knowledge). 

- Those participants who score higher on the Guilford-Zimmerman Test will score 
higher on the Pointing Task Test (survey knowledge). 

- Those participants who score higher on the Magnet Board Test will score higher on the 
Pointing Task Test. 

C. PARTICIPANTS 

Forty participants (33 male and 7 female with an average age of 32.5) participated in the 
experiment. Each treatment was administered to ten subjects. Prior experience with VEs varied 
among all subjects and within each group. Subjects were assigned to groups at random The only 
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reason participants were disqualified was that they had been in the VE prior to being tested. Ail 
participants had normal or corrected to normal vision and all spoke English fluently. 

D. BASIC TASKS AND APARATUS 

The main task in the experiment involved going through a virtual environment from the 
perspective of an automobile passenger and remembering the buildings, the locations of those 
buildings, and the route traveled through the virtual town. All participants were briefed on how 
these tasks were going to be measured as well as being able to see how the tests were going to be 
conducted. All groups were given identical instructions throughout the experiment. 

All participants were given the same visual display, three large televisions that displayed 
a 133-degree field of view of the VE (Figure 8). All sound stimuli were generated from speakers 
placed behind the participant. 
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E. MEASURES 


Measuring presence in VEs has been studied a great deal in the past few years. 
Currently, there is not an objective means of measuring this phenomenon. However, there is a 
great deal of data to suggest that the self-assessed Presence Questionnaire (PQ) developed by 
Witmer and Singer [WITM 98] does provide a valid way to measure presence, but it is subjective 
and its repeatability. is questionable. The PQ measures the degree to which individuals 
experience presence in a VE, but also suggests what contributing factors affected the intensity of 
the experience. This questionnaire was used for this study in order to correlate spatial 
comprehension with presence. 

Measuring spatial knowledge has also been studied in great detail, however it was 
important that all three types of spatial knowledge, landmark identification, route and 
procedural, and survey knowledge, be captured in the results. To measure the amount of survey 
knowledge acquired, a Pointing Task Test was used. It was conducted at the conclusion of the 
trial in the VE. A short sequence (approx, ten seconds) was replayed bringing the subject to a 
specific, predetermined location in the VE via the same route traveled in the trial. At this 
location the subject was asked to point to a number of locations which are outside the current 
view or at least occluded in the current view. This was done using a circular protractor mounted 
to the desk in order to acquire as precise a measurement as possible (Figure 9). 
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Figure 9: The Egocentric Pointing Task with Protractor Device Mounted to Table 


To determine the amount of landmark and procedural knowledge acquired in the VE, a 
Magnet Board Test was used (Figure 10). This second measurement of spatial comprehension is 
a Map Building Task. It was conducted at the conclusion of the VE trial and after the Pointing 
Task. Each subject is brought to a table and given a set of magnetic representations of buildings 
and landmarks that may or may not have been seen during the trial. The task begins by having 
each subject selecting all the magnets that can be remembered among all the choices presented. 
At this point, a metal board on which a road network of the VE is depicted is provided to the 
subject. The subject is then instructed to place the magnets selected on the map. Finally, using a 
set of magnetic strips, the subject is asked to describe the route taken through the town. The 
entry and exit points are given as well as the objects used during the Pointing Task Test, however 
the orientation of the map is left to the subject. It should be noted that the placement of the 
magnets and the identification of the route were done simultaneously with each subject 
completing the tasks in the order of their choice. A number of spatial measures are computed 
from these tasks. The landmark identification score is the number of correct landmarks that were 




selected from the original set of magnets. The map building score is an aggregate score 
computed by the placement of the landmark magnets on the route network and the identification 
of the route. 



Figure 10: The Exocentric Map Building Task Using Magnets 

The map building task was used to overcome inherent deficiencies with map drawing 
tasks that have been used in the past. Although it is a visually dominant task, it has the 
advantages of a free-recall task [FRAN 71][ROEN 78]. By allowing the subject to develop the 
environment over time rather than in a sequential fashion, which is required in a map drawing 
exercise, the subject is more able to precisely complete the task (Figure 11). This measurement 
was developed from a simple target placement task used in a previous experiment [GEOR 98]. 
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Figure 11: Completed Map Building Task 


F. CONTENT 

The VE storyline involved each subject being a passenger, in an automated vehicle. This 
vehicle was owned by a local realty company and was going to take each subject on a tour of the 
town. Each subject was given audio stimuli that provided information regarding the town with 
the exception of the No Sound Treatment. 

The tour began just outside of the town and ended shortly after leaving the town. While 
in town, subjects were given information about various landmarks both visual and auditory in 
nature. The content of the auditory portion varied by treatment. In the semantic only treatment, 
subjects were provided information that contained no spatial references. It was limited to 
describing other aspects of the town, such as the age of a building. Additionally, other sounds 
were included. They were the sound of the vehicle’s engine, other vehieles in the town, and the 
vehicle’s radio. The spatial only treatment was limited to including only spatial references, such 
as a building being located on the Northwest corner of town. All other .sound was removed. The 
spatial and semantic combined treatment ineluded both the semantie and spatial treatments to 
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provide not only spatial references but non-spatial information as well. Finally, the no sound 
treatment occluded all sound. 

The only interaction with the VE provided to each subject was via the joystick, which 
gave the ability to move the subject’s head, but did not control the vehicle’s movement in any 
way (Figure 12). The vehicle’s route and speed were under the control of the computer and 
provided consistent information across all treatment groups. 



Figure 12: BG Systems Flybox 

G. PROCEDURES 

Step One: The experimental area was completely set up prior to the arrival of each 
subject (See Appendix B). The participant was given a detailed in-brief (See Appendix C) 
outside the experimental area. Each subject was asked to read and sign the Consent and Privacy 
Act Forms (See Appendix D). The subject was then asked to complete a set of pre- 
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questionnaires and spatial ability tests (See Appendix E). Once all the pre-questionnaires and 
tests were completed they were escorted to the experimental area to proceed with the experiment. 

Step Two: Once each subject entered the experimental area they were instructed to be 
seated in front of the three-screen display. They were then given a brief on the tasks to be 
completed. This included physically showing them the Pointing Task Test and Magnet Board 
Test apparatus (See Appendix C). The purpose of doing this was to ensure every subject 
understood what to pay attention to during the experiment. Before starting the experiment each 
subject was familiarized with the Flybox and its capabilities. After each subject demonstrated 
that they understood how to utilize the Flybox, the experiment began. 

Step Three: When the first VE experience ended, the subject was administered the 
Pointing Task Test (See appendix E) and the Magnet Board Test (See Appendix E). Next, each 
subject was given the Presence Questionnaire (See Appendix E). This concluded the first 
exposure. 

Step Four: All participants were then given the opportunity to take a five-minute break. 
At the conclusion of the break, each subject was given the identical VE experience received 
during the first experience. When the second VE experience ended, the subject was again 
administered the Pointing Task Test followed by the Magnet Board Test. The participants were 
not able to view their responses to the first test with one exception. On the second Map Building 
Task, the subjects were given the original route from the first Map Building Test. All other 
aspects of the test remained the same. At the conclusion each participant was given a short 
debriefing and allowed to ask questions. This concluded the experiment. 
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V. ANALYSIS 


A. INTRODUCTION 

This chapter reports the results of the experiment that investigated the amount of spatial 
knowledge acquired in a VE as a function of presence. The dependent measures for every 
treatment included the Presence Questionnaire (PQ), Landmark Identification Score, Map Building 
Score, and Pointing Task Score. 

The PQ was used to measure the subjects’ self-assessed level of presence in the VE. The 
score was computed by summing the subjects’ responses to the questions that were on an eight- 
point scale. 

The Landmark Identification, Map Building, and Pointing Task scores were used to 
measure the amount of spatial knowledge acquired in the VE. The Landmark Identification score 
was computed by giving each correctly identified landmark one point. There were no penalties for 
incorrect landmark identification. The Map Building score was computed by rating each of the 
landmarks selected on a scale of four. Each landmark placed on the map was given one point for 
its selection, one point for its location based on absolute location, one point for its location relative 
to the route taken, and one point for its location relative to other objects. The Pointing Task score 
was computed in two ways. First, Pointing Task scores were computed by giving one point for 
every task that was within fifteen degrees of the correct answer and no points for answers that 
exceeded fifteen degrees. Additionally, the average deviation on all pointing task measures was 
computed. 
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B. POWER ANALYSIS 


Unless otherwise noted, the tests reported here are simple regression analyses between four 
different treatments: no sound, verbal cues without spatial content and background noise, verbal 
cues with spatial content only, and a combination of verbal cues with and without spatial content 
and background noise. The sample size was forty participants. An alpha value of 0.10 was used, 
resulting in a power value (1-Beta) of 0.6334. Therefore, the ability to reject the null hypothesis 
may be unreliable. This suggests that drawing conclusions based on the inability to identify a 
positive effect on any factor may be inconclusive. 


C. PRIMARY RESULTS 

1. Primary Hypothesis: 

As the level of presence in a VE increases the amount of spatial knowledge acquired in 
a virtual environment will also increase. 

Determining the effect presence has on the ability to acquire spatial knowledge requires 
that each aspect of spatial knowledge be examined. Landmark, procedural and route, and survey 
knowledge were analyzed to determine if there exists a correlation with presence. This section 
examines each type of spatial knowledge individually to understand how each is affected by 
presence. 

Measuring the differences among all the spatial knowledge tests, we can make a 
comparison between the level of presence and the amount of spatial knowledge acquired, 
irregardless of the treatment received, as measured by the Map Building and the Pointing Task 
Tests. A simple regression test was used with the Presence Questionnaire score as the independent 
variable and the spatial task scores as the dependent variables. 
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The first type of spatial knowledge to be examined is landmark identification. Landmark 
identification was measured by participants identifying landmarks they had seen in the VE from a 
group of possible landmarks that were symbolically represented by magnets. The results, F(l,39) 
= 2.043, P = 0.1609, suggest that the ability to identify landmarks was not significantly different as 
a function of presence (Figure 13). This implies that presence does not impact the ability to 
acquire landmark knowledge. 


Regression Plot Presence Questionnaire and landmark 
selection score 



Figure 13: Regression Analysis of Presence Questionnaire and Landmark Identification Task 


These results were not unexpected. Satalitch [SATA 98] found that the ability to identify 
landmarks was unaffected regardless of whether the information was presented via video or from 
the real world. This research and the data suggest that presence is not required to enhance, nor 
does it enhance, a person’s ability to identify landmarks. For example, many people have not 
visited New York City. However, most are capable of identifying the Empire State Building and 
Statue of Liberty. This implies that landmark identification is in large part a visual memory 
exercise that does not require one to feel present in an environment, real or virtual, to acquire 
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knowledge that is purely visual. Additionally, since the landmarks were represented symbolically 
instead of actual landmark images, participants were required to build a mental picture of the 
landmark then recall if that landmark had been seen in the VE. For instance, for a participant to 
select the Catholic Church, a mental picture of the church (as seen in the VE) must be built in 
order for it to be selected. This resulted in few participants selecting landmarks that were not 
represented since they did not have a mental picture to assign to the landmark. Therefore, the 
variances of the results were due to the non-selection of landmarks that were present in the VE, not 
the incorrect selection of landmarks not represented. This implies that a person’s visual memory 
was more responsible for the results than the level of presence experienced by the participant. 

The second type of spatial knowledge examined is route and procedural knowledge that 
was measured via the Map Building Test. Participants were given a road network of the VE town 
and asked to correctly place landmarks on the map as well as identify the route taken through the 
VE. The Map Building Task was not impacted by the level of presence, F(l,39) = 0.466, P = 
0.4989 (Figure 14). This suggests that the ability to acquire procedural and route knowledge is not 
significantly affected by differing levels of presence. Figure 14 shows that as the level of presence 
increased there was not a corresponding increase in the Map Building Score. For example, the 
participant with the highest reported level of presence (170) was less than fifty percent successful 
in completing the Map Building Task. 
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Regression Plot Presence Questionnaire and Map 
Building Score 



Figure 14: Regression Analysis of Presence Questionnaire and Map Building Score 

The result that presence was generally not a factor in contributing to the acquisition of 
landmark and procedural knowledge can be attributed to the fact that they are both visual memory 
exercises. A participant who experienced a higher level of presence did not improve his ability to 
acquire route and procedural knowledge from the VE. The visual memory aspect of the task 
appears to have been the determining factor in acquiring both landmark and procedural knowledge. 
This supports the work of Thorndyke [THOR 80] who found that route knowledge could be 
acquired by direct exposure or through simulated experiences such as video. This suggests 
presence is not necessary for acquiring landmark or procedural knowledge, and in this study did 
not enhance, nor degrade, the ability to acquire route and procedural knowledge. 

The last type of spatial knowledge to be examined is survey knowledge. Survey 
knowledge was measured via a Pointing Task. Participants were asked to point in the direction of 
various landmarks in the VE that were either occluded or outside the participant’s field of view. 

When looking at a comparison between presence and the ability to acquire survey 
knowledge in a VE, the results show that the level of presence has no effect on the ability to 
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acquire spatial knowledge. The results, F(l,39) = 0.044, P = 0.8359, show that the degree to which 
there is no significant difference is substantial (Figure 15). 


Regression Plot Presence Questionnaire and Pointing 
Task 



Figure 15: Regression Analysis of Presence Questionnaire and Pointing Task Hits 


This indicates that the ability to acquire survey knowledge is not only independent of the 
level of presence, but rather heavily dependent on the subject’s innate spatial abilities. Further, 
based on the earlier results and the idea that survey knowledge is enhanced by knowledge learned 
at lower levels (landmark and procedural knowledge), as Thorndyke [THOR 80] suggests, 
presence was not a determining factor in the amount of survey knowledge acquired. However, the 
amount of procedural and landmark knowledge did affect the amount of survey knowledge 
acquired, suggesting that the visual memory aspect of the Map Building Task and the theory that 
spatial knowledge is gained hierarchically (Figure 1) as Thorndyke’s model shows, were major 
contributing factors. The results, F(l,39) = 0.044, P = 0.0021, show conclusively that as the Map 
Building Task Score improves the number of “hits” recorded during the Pointing Task is also 
likely to improve (Figure 16). 
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Regression Plot Map Building Task and Pointing Task 



Figure 16: Regression Analysis of Presence Questionnaire and Pointing Task Hits 


2. Secondary Hypothesis: 

Given four different auditory treatments, individuals will experience a higher level of 
presence in a virtual environment given any sound cues compared to those who receive 
no sound cues. 

An objective comparison can be made between the four treatments with regards to the 
reported levels of presence. An ANOVA Post-hoc Test was used with the PQ score as the 
dependent variable. Figure 17 shows that the introduction of sound of any type significantly 
increases the reported level of presence experienced in a VE with a reported F(3,37) = 3.897, 
P = 0.0162. In all cases, the introduction of sound increased presence when compared to the No 
Sound treatment, however there were no significant differences between any of the Sound 
treatments. The results in this case are conclusive. The interesting point is that there is a 
significant difference between any treatment that introduces sound cues as compared to the No 
Sound treatment. This is in accordance with the findings from Lawson [LAWS 98]. This also 
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supports the past results as reported by Gilkey [GILK 95] and Hendrix [HEND 96] that suggest 
aural stimuli are a necessary factor in increasing the level of presence in a VE. 


interaction Line Plot for PQ-SUM 
Effect: TREAT 



Figure 17; Presence as a Function of Sound Treatments 


However, comparing the various sound treatments, the treatment that provided only verbal 
cues with spatial content provided the highest level of presence. Based on the theory that presence 
is the feeling of being in another place, the other treatments that included sound such as the vehicle 
engine and radio should provide a higher sense of presence. Why is this not the case? It appears 
that these other sounds acted as a distracter ffoin the primary task to acquire spatial knowledge, 
particularly when compared to the verbal cues with spatial content and background noise since this 
treatment contained the same spatial content that was provided by the spatial only treatment. 
Further evidence of this is the fact the treatment that contained verbal cues without spatial content 
also produced lower levels of presence. Although in this case the verbal cues provided 
information related to the landmarks, they did not provide any information with regards to the 
primary task (acquiring spatial knowledge). Although the results were inconclusive, they suggest 
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that presence increases with the inclusion of sound, but if the sound is unrelated to the primary task 
the resulting level of presence may be lower. 

If the data is examined and the questions that are directly related to sound are removed, the 
results change. An example of these questions would be “How did the auditory aspects of the 
environment involve you?” and “How well could you identify sounds?” One might thin k that these 
questions were the reason for the primary results, which clearly indicate that presence was 
enhanced with the inclusion of sound. Figure 18 shows that after the sound specific questions are 
removed from the PQ score, the results only change slightly. 


Interaction Line Plot for PQ(NO SOUND) 
Effect: TREATMENT 



Figure 18: Presence as Function of Sound Treatments (without PQ sound questions) 


The treatment that provided only verbal cues with spatial content was again significantly 
different from the No Sound treatment. While any comparisons between the remaining treatments 
are inconclusive, this data does continue to suggest that the inclusion of non-spatialized sound 
increases presence and the inclusion of non-spatialized sound that can be described as “task 
related” produce higher levels of presence than those treatments that are not task related. 
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Further scrutiny of the PQ reveals the reason for the increase in the level of presence for the 
treatment that included only verbal cues containing spatial content. Since the primary task was the 
acquisition of spatial knowledge, those PQ questions that relate to spatial awareness or were task 
specific in nature were examined. These questions included PQ question numbers 10, 12, 14, 18, 
19, 20, 21, 27, 30, 31, 32 (See Appendix E-4). Figure 19 and Table 1 show that the spatial only 
treatment was significantly better than the other sound treatments. This suggests that exclusively 
including sound that is relevant to the primary task improves the level of presence in a VE. 


interaction Line Plot for PQ-(SA) 

Effect: TREATMByfT 

Row exclusion: PQNOSD.xls (imported) 



Figure 19: Presence as Function of Sound Treatments (only PQ Spatial Questions) 


Fisher's PLSDfor PQ-{SA) 

Effect: TREATMENT 
Significance Level: 5 % 

Row exclusion: PQNOSD.xls (imported) 



Mean Diff. 

Crit. Diff 

P-Value 

P, s 

-5.600 

5.518 

.0469 

P,SP 

-1.200 

5.518 

.6590 

S, SP 

4.400 

5.518 

.1134 


Table 1: Presence as Function of Sound Treatments (only PQ Spatial Questions) 
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Based on the theory that attention is positively correlated v^ith presence via increased 
immersion [LAWS 98], it is reasoned that verbal cues without spatial content caused participants 
to focus on disregarding this information taking their attention away from the primary task. This 
superfluous information caused participants to split their attentional resources, which resulted in 
lower levels of presence. Further, combining spatial content with non-spatial content again 
required participants to filter out the superfluous information, thus splitting their attentional 
resources. This “split” of attention again resulted in lower levels of presence, even though all the 
relevant spatial information was still provided. 

These results suggest that the rush by developers to include all sounds and stimuli that are 
found in the real world may be unnecessary. The goal of VE in most cases is to enhance learning 
and enjoyment, so while some superfluous sounds may provide realistic audio stimuli, their 
inclusion does not necessarily translate to better VE design and performance or higher levels of 
presence. The results suggest that varying a component of immersion (sound) impacts multiple 
components of presence (spatial awareness and attention) and these effects may counteract one 
another with the overall result of lower presence. 

3. Sub-Hypothesis: 

First Sub Hypothesis: Those participants who score higher on the Building Memory Test 

will score higher on the Map Building Test (procedural and route knowledge). 

A comparison of the Building Memory Test score and the Map Building Test Score can be 
made. Using a simple regression with the Building Memory Test as tl-e independent variable and 
the Map Building Score as the dependent variable, there was conclusive evidence that a high score 
on the Building Memory Test lead to an improved score on the Map Building Task (Figure 20). 
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Results, F(l,39) = 6.554, P = 0.0039, suggest that a participant’s innate ability as measured by the 
Building Memory Test are predictive of performance on the Map Building Test. 


Regression Plot 



Figure 20: Regression Analysis of Building Memory Test and Map Building Score 


These results are due to the fact that both are strictly visual in nature and both are done 
from an exocentric point of reference. The Map Building Test and the Building Memory Test are 
both a purely visual memory exercises. However, when sound is introduced, the means of 
providing information is bimodal instead of strictly limited to the visual modality. Since this 
information is largely unrelated to acquiring spatial knowledge it does not significantly affect the 
Map Building Score. Therefore, the Building Memory Test is predictive of the Map Building 
Score even though the means of acquiring spatial knowledge is no longer limited to the visual 
modality, but includes aural stimuli, which is not taken into account by the Building Memory Test. 

A comparison of the Building Memory Test score and the score on the spatial knowledge 
acquisition tests relating to survey knowledge can be made. The results, F(l,9) = 6.118, P = 
0.1633, suggest that there are no significant differences among Building Memory scores and the 
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Pointing Task Tests (Figure 21). This implies that while the Building Memory Test is a visual 
memory test, the Pointing Task Tests, which require survey knowledge, are not. Although these 
results are not conclusive, it does support [SATA 95]. 

Regression Plot 



Figure 21: Regression Analysis of Building Memory and Pointing Task Hits 

Second Sub Hypothesis: Those participants who score higher on the Guilford- 

Zimmerman Test will score higher on the Pointing Task Test (survey knowledge). 

The study also provided a comparison between the results of the Guilford-Zimmerman 
Spatial Aptitude Test and the Pointing Task Test. A simple regression test with the Guilford- 
Zimmerman score as the independent variable and the Pointing Task score as the dependent 
variable was conducted. The data suggests that the score on the pointing tasks improved as a 
function of the Guilford-Zimmerman Spatial score. The results, F(l,39) = 2.817, P = 0.1012, 
indicate that there is a difference between the average degree of error and the Guilford- 
Zimmerman score. Further analysis reveals that the Guilford Zimmerman becomes predictive of 
the Pointing Test Task when spatial references are included. Figure 22 shows the relationship of 
the Guilford-Zimmerman Test score and the Pointing Task score for all treatments. 
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Regression Plot 



Figure 22: Regression Analysis of Pointing Task and Guildford-Zimmerman Test 

The Pointing Task Test is a measure of the amount of survey knowledge acquired. Since 
survey knowledge is thought to be the most difficult to acquire, it follows that a participant with 
higher spatial abilities would have a better Pointing Task Score. This result implies that innate 
spatial abilities are more important than presence in gaining survey knowledge in a VE. 

It is interesting to note that after the second VE experience, scores on the pointing task, 
F(l,39) = 1.209, P = 0.2816, did improve, but there was not a significant difference between the 
second Pointing Task Score and the results of the Guilford-Zimmerman Test. This result was 
unexpected since the second exposure would allow for the acquisition of more survey knowledge. 
However, the improved scores were not strongly related to the innate abilities of the subjects. 

Third Sub Hypothesis: Those participants who score higher on Map Building Test will 
score higher on the Pointing Task Test. 

Comparing the results of the Map Building Test and the Pointing Test there was a 
significant difference, F(l,39) = 12.13, P = 0.0021, which indicates that a high score on the Map 
Building Test will lead to a high score on the Pointing Task Test. This supports the claim that 
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survey knowledge is improved with better procedural knowledge [GOER 98]. Figure 23 suggests 
that the Map Building score is predictive of the amount of survey knowledge acquired. 



Figure 23: Regression Analysis of Map Building Score and Pointing Task Score 

A high Map Building score indicates that a high level of procedural knowledge was 
acquired. This procedural knowledge enhanced the user’s ability to acquire survey knowledge. As 
Thorndyke’s Hierarchical Model suggests, knowledge at one level (survey) is enhanced by 
knowledge gained from the previous level (procedural). 


D. SUMMARY 

The results of the various comparisons made throughout this chapter suggest the following. 
First, including non-spatialized sound in a VE display does increase the level of presence, however 
if the sound is exclusively related to the primary task the level of presence is further increased. 
Second, presence is not a predictor of performance of spatial tasks in a VE. The data suggests that 
other factors are more predictive of spatial performance. Individual spatial abilities and visual 
memory are better predictive measures of spatial performance as compared to presence. Last, the 
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associative relationship discussed in chapter in between non-spatialized sound, presence, and 
spatial performance does not exist. 

The initial thought was that the addition of non-spatialized sound would increase 
performance of spatial tasks. This was based on three main ideas. First, including verbal cues 
with only spatial content was thought to increase performance based on the idea that using multiple 
modalities to convey spatial information would result in improved performance. Second, 
including verbal cues without spatial content would improve performance simply based on 
hypothetical models of working memory [BADD 78]. Last, including both spatial and non-spatial 
cues would improve performance based on the combined effects of the previous two ideas. 
However, the results show that this is not the case. Results indicate that including topical 
information such as that which was contained in the verbal cues without spatial content does not 
provide any help with indexing memory as had been anticipated. Although including verbal cues 
with spatial content appears to improve performance, the results were inconclusive and 
contradictory in some cases. 

Figures 24, 25, and 26 show the results of an ANOVA post-hoc test conducted on the three 
measures of spatial performance. There were no significant differences among the treatments, but 
the data and figures below suggest performance of all spatial tasks is improved with the exclusive 
inclusion of verbal cues with spatial content, while those who received verbal cues without spatial 
content generally performed poorly as conqjared to the other treatments. 
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Interaction Line Plot for selection score 
Effect: TREAT 



Figure 24: Treatments vs. Landmark Selection Score 


Interaction Line Plot for MAPI-PERCETsTT 
Effect: TREAT 



Figure 25: Treatments vs. Map Building Test 
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Interaction Line Plot for PT1-HITS 
Effect: TREAT 



Figure 26: Treatments vs. Landmark Selection Score 

Additionally, the no sound group performed better on the Map Building Task and 
performed much worse on the Landmark Selection Task as compare to the other treatments. Those 
who received the combined treatment of verbal cues containing both spatial and topical 
information performed as well as the spatial group on the Landmark Selection and Map Building 
Task, but performed more poorly than aU other groups on the Pointing Tasks. Therefore, the 
results do not generally support the use of non-spatialized sound as a measure of spatial 
performance. However, based on the counterintuitive nature of these results it should be clear that 
more research is needed in this area. 
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VI. 


CONCLUSIONS 


A. SUMMARY 

The purpose of this study was to investigate the effect that presence has on the ability to 
acquire spatial knowledge in a VE. Additionally, the effect of including various non-spatialized 
sound cues on the level of presence in a VE was examined. 

The experimental design was based on the idea that if presence could be shown to improve 
performance on spatial tasks and that non-spatialized sound could increase the level of presence, 
then sound could be correlated with the ability to perform spatial tasks. The results were 
inconclusive, however it cannot be assumed that presence does not impact performance in some 
manner. Presence may not affect performance in general, however it may later be shown that 
presence may, in fact, affect specific types of performance on specific tasks. However, this will 
require further research. Additionally, the results do suggest that there are elements of presence 
that are not related exclusively to non-spatialized sound, but relating these sounds to performance 
was inconclusive. 

In summary, the significant findings of this study are as follows: 

- Results indicate that the level of presence had no significant effect on the ability to 
acquire spatial knowledge in a VE. 

- Including non-spatialized sound cues in the display significantly increased the reported 
level of presence in a VE. 

- The types of non-spatialized sound, whether or not they contain spatial content, 
contribute to higher levels of presence. 

As the amount of procedural and route knowledge increases, the amount of survey 
knowledge also increases. 
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These results provide important information on the importance of presence in VEs. 
Although this study suggests that presence was not required for acquiring spatial knowledge, 
there is likely other knowledge and learning that can be enhanced if the VE provides a greater 
sense of presence to its users. 

B. RECOMMENDATIONS 

In reviewing the data there are several ways in which the experiment could have been 
improved. First, the sound treatments should have been further decomposed into specific 
components. Every sound treatment contained verbal information that was either spatial or non- 
spatial in nature. In retrospect, the experiment should have contained a treatment that had no 
verbal information, but rather only that of the vehicle’s engine and radio. This would have 
provided more evidence that any sound increases the reported level of presence. It should be 
noted that this was done during an early pilot study and the results, although anecdotal in nature, 
suggested that presence increased with only the car’s engine and radio. 

Second, it is recommended that the Landmark Selection Task and Map Building Test be 
converted from exocentric tasks to egocentric tasks. The methods used required participants to 
complete a 90-degree mental rotation of the VE in order to complete the tasks even though all 
knowledge was acquired from an egocentric viewpoint. For example, the Building Memory Test 
required participants to transform all knowledge of the landmarks and route gained from the 
egocentric point of view to an exocentric point of view that was required of the Map Building 
Task. This could be done by administering an egocentric Landmark Selection Task and Map 
Building Test. Having each participant manually navigate the VE and identify landmarks within 
the VE would accomplish this. The landmarks could be represented as gray boxes and the 
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participant would simply identify what landmark was located in that position during the initial VE 
experience. The benefit would be that participants who are poor at mental rotations would no 
longer have to make the rotations and the shortcomings of the symbolically represented 
landmarks would be eliminated. Additionally, the Pointing Task could be conducted 
simultaneously thus reducing any learning that may occur as a result of administering the Pointing 
Task prior to the Landmark Selection Task and Map Building Test. 

Last, it would be interesting to know how presence affected a subject’s ability to recall the 
spatial and topical knowledge at a later time. The experiment was conducted with both treatments 
being administered in a short period of time. This leaves the following question unanswered: Are 
subjects who experience higher levels of presence better able to recall spatial and topical 
information over time than those who experience lower levels of presence? Perhaps an 
experiment that tested subjects a week after their initial exposure would answer this question. 
Including these elements would provide more insight into the effects of presence as well as 
valuable knowledge for future research. 

C. FUTURE WORK 

This thesis has explored the relationship between presence and the ability to acquire spatial 
knowledge in a VE. It demonstrates that little is known or understood about the phenomenon of 
presence. We still do not know the full importance of presence in VEs, however we can clearly 
see that the effects of presence can be counterintuitive when relating presence to performance. A 
quantitative measure for presence has yet to emerge, although this area has been studied in depth. 
What should future research focus on in its attempt to study presence? 
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Future research should explore the effects of proprioception and its effect on presence and 
performance more thoroughly. Further, an examination of all the effects of presence on acquiring 
knowledge in VEs would be useful. Examples should be, but are not limited to, distance 
estimation tasks, various exposure times, and training transfer aspects resulting from presence. 

Another area that needs to be examined is the comparison of an egocentric point of view and 
exocentric point of view and the related effects of presence in VEs. Implicit in the current 
definitions of presence is an egocentric viewpoint. The ability to be located in a place other than 
where one’s body is physically located suggests an egocentric viewpoint. It would be interesting 
to examine how an exocentric viewpoint affects a person’s level of presence and its related effects 
on performance. It seems logical to believe that the VE viewpoint must be believable or 
somewhat realistic to induce a high sense of presence. This research would be relevant 
particularly for simulator training. For example, a flight simulator that provides the pilot a 
cockpit viewpoint (egocentric) as conqjared to the wingman viewpoint (exocentric) would be 
valuable to understanding presence. It seems logical to believe that the user who has the cockpit 
viewpoint would likely experience higher levels of presence than a user that had the exocentric 
viewpoint as well as more opportunities to enhance performance and transfer knowledge gained 
from the VE experience. Furthermore, this would also be related to proprioception research. 
From an egocentric viewpoint, proprioception is possible and perhaps desirable. However from 
the exocentric viewpoint, proprioceptive methods seem unnatural and implausible. 

Another area that warrants further research would be an examination of the relationship 
between presence and perceived performance. It was interesting to note during this experiment 
how various sound treatments affected the level of presence, particularly how the inclusion of 
noise and unrelated verbal information resulted in lower levels of presence. These results are 
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somewhat unexplainable, however it may be that the “noise” created a sense of doubt among 
participants’ ability to complete the various spatial tasks. An interesting study would be to 
examine how people perceive their performance (regardless of the actual outcome) and relate this 
to presence. Perhaps as people “feel” better about their performance, the more likely they are to 
answer questions about presence in a positive manner as compared to those who are unsure or 
believe they performed poorly. 

This study began looking at the effect of presence on spatial performance. When we answer 
the questions posed here, we will be better able to build VEs that meet the needs of the users. 
Many of these needs currently go unfulfilled, resulting in systems that are expensive and provide 
less than the desired results. Our goal should be the same as Ivan Sutherland, who in 1965 
described the “ultimate display” that included full-color, stereoscopic, high-resolution imagery, 
filling the user’s entire field of view [SUTH 65]. This can be summarized as a display that 
appears seamless when compared to the real world, where presence is a controllable design 
element used to enhance performance on tasks within the VE. 
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18/24 
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APPENDIX B. EXPERIMENT OUTLINE 


EXPERIMENT PRE-CHECK LIST 

a. Unplug telephone in lab 

b. Section off experiment area 

c. Post “Quiet Experiment in Progress” Sign 

d. Turn on power to 3 screen display and amplifier 

e. Ensure audio is set up and ready 

f. Ensure Flybox is on and positioned correctly 

g. Ensure Pointing Test and Magnet Board Test are ready 

h. Ensure table and chair is provided 

i. Ensure digital camera is available and ready 

j. Start experiment program (ezs_rtm_pf20_o62 -s UFO_3screen2.set -S -P3 -L) 

k. Load recording FI Key 

l. Play recording PAGEDOWN/HOME Key 

m. Stop recording END Key 

n. Rewind recording INSERT Key 

o. Welcome subject and complete consent forms 

p. Administer pre-questionnaires 

1. Immersive Tendency Questionnaire (ITQ) 

q. Administer Spatial Abilities Test 

1. Visual Memory Test (Building Memory Test) 

2. Guilford-Zimmerman Test 

r. Escort subject to Graphics Lab 

s. Ensure subjects are seated and comfortable in front of 3 screen display 

t. Give subject experimental area in-brief 

u. Enter subjects trial number 
V. Start experiment program 



2 . 


EXPERIMENT POST-CHECK LIST 


a. Rewind recording appropriately INSERT Key 

b. Prepare subject for Pointing Test 

c. Record data from Pointing Test 

d. Remove subject from experimental area 

e. Prepare subject for Magnet Board Test 

1. Initial Selection Test 

2. Map Construction Test 

f. Take digital pictures of maps 

g. Have subjects complete Post-questionnaires 

1. Presence Questionnaire (PQ) 

h. Debrief and thank subject for participation 

i. Ensure all data is recorded properly 

j. Plug in telephones 

k. Remove “quiet experiment in progress” sign 
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APPENDIX C. INBRIEFING SCRIPT 


1. GENERAL 

The scripts in this appendix appear in the same format as that used for the experiment. 
This appendix consists of the entire In Brief sequence, that is, the In Briefing prior to entering the 
experiment area as well as the In Briefing upon entering the experiment area. Each subject receives 
the entire In Brief. This appendix also contains the Debriefing handout that is provided to every 
subject as well. 

2. IN-BRIEFING 

Welcome to the Naval Postgraduate School’s Computer Department. My name is David 
Bernatovich and I would like to thank you for your assistance with today’s experiment. This 
experiment involves presence and the acquisition of spatial knowledge in a virtual environment. 

This experiment is not a test of your performance or mental capabilities. It is, however, a 
test to determine the relationship between of person’s level of presence in a VE and their propensity 
to acquire spatial knowledge from that VE. All information is confidential and will be kept in strict 
confidence. 

Prior to getting started, I would like you to read and sign a consent form. After signing 
the consent form, you will take a few short tests and answer a pre-questionnaire. This should take 
approximately 20 minutes. Upon completion of the pre-questionnaires, you will be escorted to the 
Graphics Lab to go through the VE. Upon completion of the VE, you will complete several tasks 
based on your experience. You will then be brought back to this room to con^lete two more 
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questionnaires followed by a short debriefing. If there are no questions please read and then sign the 
consent form. 

Before we get started let me explain the tasks you will be asked to complete after your 
VE experience. There will be two tasks and both are designed to determine the level of spatial 
knowledge that you acquired from the virtual world. First, you will be asked to con:q)lete a Pointing 
Test Task. This involves going back into the virtual environment and using this pointer to aim in the 
direction of various objects that you saw. Second, you will be asked to complete the Magnet Board 
Test. This involves several steps. First, you will be asked to select the buildings that you saw from 
this group of magnetic representations of buildings. Some you will have seen and some you will 
have not. Second, you will be asked to place these magnets on this rudimentary map of the virtual 
environment. This is the road network of the town you will be going through. You will also be 
asked to identify the route you took using these gray colored magnets. If you have no questions 
allow me to set the stage for you. You have just moved to a new town. The company that you are 
going to work for has set up an appointment with a realty Con^any. The realtor uses a remote- 
controlled vehicle and automated tour prior to meeting with you to discuss your interests. The tour 
will show you the town. The tour begins just before entering the city limits and ends shortly after 
leaving the town. You will be cued when you enter the town (i.e. the magnet board) as well as when 
you leave. After the tour you will be given the tests discussed earlier. Again, if you have no further 
questions let’s get started. 
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3. DEBRIEFING (upon completion of post-questionnaires outside of experiment area) 


Today, virtual environments are increasingly becoming a major force in training as well 
as entertainment. Although the technology we use to create these virtual worlds has increased 
dramatically, there remain many questions relating to what is required in a VE to ensure we 
maximize the benefits of this type of training or experience. 

The experiment you have just completed is concerned with the effect presence has on a 
person’s ability to acquire spatial knowledge in a VE. You were provided one a four possible 
treatments in the VE. They were: No Sound, Presence Sound only. Spatial Information Only and 
both Spatial and Presence combined. This experiment is attempting to find a relationship between 
the level of presence and the ability to acquire spatial knowledge. 

Four groups are being tested based on the treatments mentioned above. The research 
personnel observed and recorded information based on the VE experience in order to determine the 
role presence has in a person’s ability to acquire spatial knowledge in a VE. The results of this study 
will be used to help VE developers determine what level of presence is required to optimize a 
person’s spatial capabilities. This will allow planners to create VE that are specifically designed to 
meet the desired needs of the real world. 

Your assistance today is greatly appreciated and will contribute to better VE construction 
in the future. With the information we are gathering from you and others, we are learning what is 
necessary to include in VEs to ensure the utility gained is maximized as well as what can be 
removed or is unnecessary to the user. 

If you have any questions about this study please ask or E-mail me with your questions. 
Please do not discuss this experiment with anyone except our research personnel until 1 June 1999. 
This is to prevent influencing any future subjects. Thank you for participating in this study. 
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Additional information on this study can be obtained from David Bernatovich at 643-9323 or E- 
mail: bematov@cs.nps.naw.mil. 


Presence and the Acquisition of 
Spatial Knowledge in Virtual 
Environments 


Last Name:_ 

Sequence Number: 
Date: 


94 




APPENDIX D. CONSENT FORMS 


1. GENERAL: 

The forms in this appendix appear in the same format used for the experiment and do not 
foUow the standard thesis format utilized in this thesis. This appendix consists of three documents: 
Consent Form, Minimal Risk Consent Statement, and the Privacy Act Statement. Each subject is 
required to read and sign these documents prior to participating in the experiment. A research 
monitor observes and verifies the signing of each document. 
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2 . 


PARTICPANT CONSENT FORM 


Spatial Awareness and Presence E^^eriment 
CONSENT FORM 

You are invited to participate in a study of presence and the acquisition of spatial 
knowledge in virtual environments. With data from you and other participants we hope to find out 
more about how people acquire spatial knowledge and how that acquisition is affected by presence in 
virtual environments. We ask that you read and sign this form indicating that you agree to be in the 
study. Please ask any questions you may have before signing. 

Background information: This study is being conducted by Captain David Bernatovich. 

Procedures: If you decide to participate in this study, the researchers will explain the tasks in detail. 
There wiU be an hour session; This session involves going through a virtual environment and then 
being asked to point in the direction of objects that you have seen. Additionally, you will be asked to 
place magnetic representations of the objects you saw on a metal board. The direction in which you 
point and the location of the objects will be recorded. 

Risks and benefits of being in the study: This study has no unordinary risks beyond those 
encountered in your everyday workplace. The benefits to participants are that they gain experience 
with virtual environments and contribute to current research in huinan-con:5)Uter interaction. 

Compensation: No tangible reward will be given. A copy of the results will be available to you at the 
conclusion of the experiment. 

Confidentiality: The records of this study will be kept private. We will not make any information 
publicly accessible that might make it possible to identify you as a participant. 

Voluntary nature of the study: If you decide to participate, you are free to withdraw at any time 
without prejudice. 

Contact and questions: The researcher involved in this study is Captain David Bernatovich 
(Spanagal Hall, rm. 267, 643-9323). You may ask any questions you have at any time. You will be 
given a copy of this form for your records. 

Statement of consent: I have read the above information. I have asked questions and have had my 
questions answered. I consent to participate in the study. 


Signature 


Date 


Signature of Investigator 


Date 
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3. 


MINIMAL RISK CONSENT STATEMENT 


NAVAL POSTGRADUATE SCHOOL, MONTEREY, CA 93943 

Subject: VOLUNTARY CONSENT TO BE A RESEARCH PARTICPANT IN: 

Presence and the Acquisition of Spatial Knowledge in Virtual Environments 

1. I have read, understand and been provided “information for Participants” that provides the details of 
the below acknowledgements. 

2. I understand that this project involves research. The purpose of the research, a description of the 
procedures to be used, identification of experimental procedures, and the duration of my participation have 
been provided to me. 

3. I understand that this project does not involve more than minimal risk. I have been informed of any 
reasonable foreseeable risks or discomforts to me. 

4. I have been informed of any benefits to me or to others that may reasonably be expected from the 
research. 

5. I have signed a statement describing the extent to which confidentiality of records identifying me will 
be maintained. 

6. I have been informed of any compensation and/or medical treatments available if injury occurs and if 
so, what they consist of, or where further formation can be obtained. 

1 . 

7. I understand that my participation in this project is voluntary, refusal to participate will involve no 
penalty or loss of benefits to which I am otherwise entitled. I also understand that I may discontinue 
participation at any time without penalty or loss of benefits to which I am otherwise entitled. 

8. I understand that the individual to contact should I need answers to questions about the research is 
Rudy Darken, Ph.D., Principal Investigator, and about my rights as a research subject or concerning a research 
related injury is the Modeling Virtual Environments and Simulations Chairman. A full and responsive 
discussion of the elements of this project and my consent has been taken. 


Medical Monitor: Hight Surgeon, Naval Postgraduate School 


Signature of Principal Investigator 

Date 

Signature of Volunteer 

Date 

Signature of Witness 

Date 
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4. 


PRIVACY ACT STATEMENT 


NAVAL POSTGRADUATE SCHOOL, MONTEREY, CA 93943 
PRIVACY ACT STATEMENT 

1. Authority: Naval Instruction 

2. Purpose: Presence and Spatial Knowledge information will be collected to enhance knowledge, or 
to develop tests, procedures, and equipment to improve the development and design of virtual environments. 

3. Use: Presence and the acquisition of spatial information will be used for statistical analysis by 
the Departments of the Navy and Defense, and other U.S. Government agencies, provided this use is 
compatible with the purpose for which the information was gathered. Use of this information may be granted 
to legitimate non-government agencies or individuals by the Naval Postgraduate School in accordance with the 
provisions of the Freedom of Information Act. 

4. Disclosure/Confidentiality 

I have been assured that my privacy will be safeguarded. I will be assigned a control number which thereafter 
will be the only identifying entry on any research records. The principal Investigator will maintain the cross 
reference between name and control 

a. I have been assured that my privacy will be safeguarded. I will be assigned a control number 
which thereafter will be the only identifying entry on any research records. The principal Investigator will 
maintain the cross-reference between name and control number. It will be decoded only when beneficial to me 
or if some circumstances, which is not apparent at this time, would make it clear that decoding would enhance 
the value of the research data. In all cases, the provisions of the Privacy Act Statement will be honored. 

b. I understand that a record of the information contained in this Consent Statement or derived 
from the experiment described herein will be retained permanently at the Naval Postgraduate School or by 
higher authority. I voluntarily agree to its disclosure to agencies or individuals indicated in paragraph 3 and I 
have been informed that failure to agree to such disclosure may negate the purpose for which the experiment 
was conducted. 


c. I also understand that disclosure of the requested information, including my Social Security 

Number, is voluntary. 


Signature of Volunteer Name, Grade/Rank (if applicable) DOB SSN DATE 


Signature of Witness 


DATE 
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APPENDIX E. QUESTIONNAIRES AND TESTS 


1. GENERAL 

The items in the appendix appear in the same format utilized for the experiment and thus 
do not conform to the standard thesis format utilized in the chapters of this document. This 
appendix consists of four documents: Immersive Tendencies Questionnaire (ITQ), Guilford- 
Zimmerman Test, Building Memory Test and the Presence Questionnaire (PQ). 



APPENDIX E-1. PRE-QUESTIONNAIRE 


IMMERSIVE TENDENCY QUESTIONNAIRE 


Indicate your answer by circling the appropriate number on the seven-point scale paying 
close attention to the particular anchors at the ends and in the middle of each new scale. 

1. Do you ever get extremely involved in projects that are assigned to you by your boss or 
instructor, to the exclusion of other tasks? 

NEVER OCCASIONALLY OFTEN 

-3 -2 -1 0 +1 +2 +3 

2. How easily can you switch your attention from a task in which you presently involved to 
a new task? 

NOT SO EASILY FAIRLY EASILY QUITE EASILY 

-3 -2 -1 0 +1 +2 +3 

3. How frequently do you get emotionally involved (angry, sad or happy) in the news 
stories you read or hear? 

NEVER OCCASIONALLY OFTEN 

-3 -2 -1 0 +1 +2 +3 

4. How do you feel today? 

NOT WELL PRETTY WELL EXCELLENT 

-3 -2 -1 0 +1 +2 +3 

5. Do you easily become involved in movies or TV dramas? 

NEVER OCCASIONALLY OFTEN 

-3 -2 -1 0 -1-1 +2 +3 

6 . Do you ever become so involved in a TV Program or book that people have problems 
getting your attention? 

NEVER OCCASIONALLY OFTEN 

-3 -2 -1 0 -1-1 -1-2 -1-3 

7. How mentaUy alert do you feel at this time? 

NOT ALERT MODERATELY FULLY ALERT 

-3 -2 -1 0 -1-1 -1-2 ' -1-3 


8. Do you ever become so involved in a movie that you are not aware of things going on 

around you? 

NEVER OCCASIONALLY OFTEN 

-3 -2 -1 0 - 1-1 - 1-2 - 1-3 
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9. How frequently do you find yourself closely identifying with the characters in a story 
line? 

NEVER OCCASIONALLY OFTEN 

-3 -2 -1 0 +1 +2 +3 

10. Do you ever become so involved in a video game that it is as if you are inside the game 
rather than moving a joy stick and watching the screen? 

NEVER OCCASIONALLY OFTEN 

-3 -2 -1 0 +1+2 +3 

11. On average, how many books do you read for enjoyment each month? 


NONE 


1 


MORE 


12. What kind of books do you read most frequently? (CIRCLE ONLY ONE ITEM) 

Spy Novels Fantasies Science Fiction 

Adventure Novels Romance Novels Historical Novels 

Westerns Mysteries Other Fiction 

Biographies Autobiographies Other non-Fiction 


13. How physically fit do you feel today? 

NOT FIT MODERATELY EXTREMELY FIT 

-3 -2 -1 0 +1 +2 +3 


14. How good are you at blocking out external distractions when you 

something? 

NOT VERY GOOD SOMEWHAT 

-3 -2 -1 0 +1 +2 ' 


are involved in 

VERY GOOD 
+3 


15. When watching sports, do you ever become so involved in the game that you react as if 
you were one of the players or a spectator at the event? 

NEVER OCCASIONALLY OFTEN 

-3 -2 -1 0 +1 +2 +3 

16. Do you ever become so involved in a daydream that you are not aware of things 
happening around you? 

NEVER OCCASIONALLY OFTEN 

-3 -2 -1 0 +1 +2 +3 

17. Do you ever have dreams that are so real that you feel disoriented when you awake? 

NEVER OCCASIONALLY OFTEN 

-3 -2 -1 0 +1 +2 +3 

18. When playing sports, do you ever become so involved in the game that you lose track of 
time? 

NEVER OCCASIONALLY OFTEN 

-3 -2 -1 0 +1 +2 +3 
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19. Are you easily disturbed when working at a task? 

NEVER OCCASIONALLY 

-3 -2 -1 0 +1 +2 


OFTEN 


20. How well do you concentrate on enjoyable activities? 

NOT AT ALL MODERATELY 

-3 -2 -1 0 +1 +2 


VERY WELL 
+3 


21. How often do you play arcade or video games? (OFTEN would be at least every two 

days) 

NEVER OCCASIONALLY OFTEN 

-3 -2 -1 0 +1 +2 +3 


22. How well do you concentrate on disagreeable tasks? 

NOT AT ALL MODERATELY 

-3 -2 -1 0 +1 +2 


VERY WELL 
+3 


23. Have you ever gotten excited during a chase or fight scene on TV or in the 
movies? 

NEVER OCCASIONALLY OFTEN 

-3 -2 -1 0 +1 +2 +3 

24. To what extent have you dwelled on personal problems in the last 48 hours? 

NOT AT ALL SOMEWHAT ENTIRELY 

-3 - -2 -1 0 +1 +2 +3 

25. Have you ever gotten scared by something happening on TV or in the movies? 

NEVER OCCASIONALLY OFTEN 

-3 -2 -1 0 -+1 . +2 +3 

26. Have you ever remained apprehensive or fearful long after watching a horror movie? 

NEVER OCCASIONALLY OFTEN 

-3 -2 -1 0 +1+2 +3 


27. Do ever avoid carnival rides because they are too scary? 

NEVER OCCASIONALLY OFTEN 

-3 -2 -1 0 +1 +2 +3 

28. How often do you watch TV soap operas or documentaries? 

NEVER OCCASIONALLY OFTEN 

-3 -2 -I 0 +1 +2 +3 

29. Do you ever become so involved in doing something that you lose aU track of time? 

NEVER OCCASIONALLY OFTEN 

-3 -2 -10 +1 +2 +3 
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30. Do you ever get motion sickness when reading in a car? 

NEVER OCCASIONALLY OFTEN 

-3 -2 -1 0 +1 +2 +3 


31. Do you ever get motion sickness when riding as a passenger in a car? 


NEVER 


OCCASIONALLY 


OFTEN 

-3 -2 

-1 

0 +1 

+2 

+3 
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APPENDIX E-2. GUILFORD-ZIMMERMAN TEST 
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Figure 27: Guilford-Zimmerman Aptitude Survey Cover Page 













APPENDIX E-3. BUILDING MEMORY TEST 


Name 


BUILDING MEMORY — MV-2 


This is a test of your ability to remember the position of things on 
a street map. 

You will be given a map with streets and buildings and other structures 
to study. After you have had some time to learn the street layout and the 
different kinds of structures, you will be asked to turn to a test page. On 
chat page you will find the street map and numbered pictures of some of the 
structures. You will be asked to put an x on the letter chat shows where 
each of the structures was located on the study map. 

Now look at this simple and enlarged sample: 



After you have studied the sample above cor a minute, turn to the 
next page. 


Copyright ® 1975 by Educational Testing Service. All rights reserved. 


Figure 28: Building Memory Test Cover Page 
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APPENDED E-4. POST QUESTIONNAIRE 
PRESENCE QUESTIONNAIRE 


Characterize your experience in the virtual environment, by circling one of the 
appropriate numbers on the seven-point scale, in accordance with the question content and 
descriptive labels. Answer the questions independently in the order that they appear. Do not skip 
questions or return to a previous question to change your answer. ANSWER ALL QUESTIONS 
WITH REGARD TO YOUR EXPERIENCE IN THE EXPERIMENT. 


1. How much were you able to control events? 

NOT AT ALL SOMEWHAT COMPLETELY 

-3 -2 -1 0 +1 +2 +3 

2. How responsive was the environment to actions that you initiated (or performed)? 

NOT MODERATELY COMPLETELY 

RESPONSIVE RESPONSIVE RESPONSIVE 

-3 -2 -1 0 +1 +2 +3 


3. How natural did your interactions with the environment seem? 
EXTREMELY BORDERLINE COMPLETELY 

ARTinaAL NATURAL 

-3 -2 -1 0 +1 +2 +3 


4. How completely were ^ your senses engaged? 
NOT MILDLY 

ENGAGED ENGAGED 

-3 -2 -1 0 +1 


COMPLETELY 
ENGAGED 
+2 +3 


5. How much did the visual aspects of the environment involve you? 

NOT AT ALL SOMEWHAT COMPLETELY 

-3 -2 -1 0 +1 +2 +3 

6. How much did the auditory aspects of the environment involve you? 

NOT AT ALL SOMEWHAT COMPLETELY 

-3 -2 -1 0 -t-1 +2 +3 


7. How natural was the mechanism which controlled movement through the environment? 
EXTREMELY BORDERLINE COMPLETELY 

ARTIHCIAL NATURAL 

-3 -2 -1 0 +1 +2 +3 


8. How aware were you of events occurring in the real world around you? 

NOT AWARE MILDLY AWARE VERY AWARE 

-3 -2 -1 0 -t-l +2 • +3 
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9. How aware were you of your display and control devices? 

NOT AWARE MILDLY AWARE VERY AWARE 

-3 -2 -1 0 +1 +2 +3 

10. How compelling was your sense of objects moving through space? 

NOT MODERATELY VERY 

AT ALL COMPELLING COMPELLING 

-3 -2 -1 0 +1 +2 +3 

11. How inconsistent or disconnected was the information coming from your various 
senses? 

NOT AT ALL SOMEWHAT VERY 

INCONSISTENT INCONSISTENT INCONSISTENT 

-3 -2 -1 0 +1 +2 +3 . 

12. How much did your experience in the virtual environment seem consistent with your real 
world experiences? 

NOT AT ALL SOMEWHAT VERY 

INCONSISTENT INCONSISTENT INCONSISTENT 

-3 -2 -1 0 +1 +2 +3 

13. Were you able to anticipate what would happen next in response to the actions that you 
performed? 

NOT AT ALL SOMEWHAT COMPLETELY 

-3- -2 -1 0 +1 +2 +3 

14. How completely were you able to actively survey or search the environment using 
vision? 

NOT AT ALL SOMEWHAT . COMPLETELY 

-3 -2 -1 0 +1 +2 +3 

15. How well could you identify sounds? 

NOT AT ALL SOMEWHAT COMPLETELY 

-3 -2 -1 0 +1 +2 +3 

16. How well could you localize sounds? 

NOT AT ALL SOMEWHAT COMPLETELY 

-3 -2 -1 0 +1 +2 +3 

17. How completely were you able to actively survey or search the environment using 
touch? 

NOT AT ALL SOMEWHAT COMPLETELY 

-3 -2 -1 0 +1 +2 +3 
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18. How compelling was your sense of moving around inside the virtual environment? 

NOT MODERATELY VERY 

COMPELLING COMPELLING COMPELLING 

-3 -2 -1 0 +1 +2 +3 

19. How closely were you able to examine objects? 

NOT AT ALL PRETTY CLOSE VERY CLOSE 

-3 -2 -1 0 +1 +2 +3 

20. How well could you examine objects from multiple viewpoints? 

NOT AT ALL SOMEWHAT EXTENSIVELY 

-3 -2 -1 0 +1 +2 ' +3 

21. How well could you move or manipulate objects in the virtual environment? 

NOT AT ALL SOMEWHAT EXTENSIVELY 

-3 -2 -1 0 +1 +2 +3 

22. To what degree did you feel confused or disoriented at the beginning of breaks or at the end 
of the experimental session? 

NOT AT ALL MILDLY VERY 

DISORIENTED DISORIENTED 

-3 -2 -1 0 +1 +2 +3 

23. How involved were you in the virtual environment experience? 

NOT MILDLY VERY 

INVOLVED INVOLVED INVOLVED 

-3 -2 -1 0 +1 +2 +3 


VERY 

DISTRACTING 
+2 +3 

25. How much delay did you experience between your actions and expected outcomes? 

NO DELAYS MODERATE LONG 

DELAYS DELAYS 

-3 -2 -1 0 +1 +2 +3 

26. How quickly did you adjust to the virtual environment experience? 

NOT AT ALL SLOWLY LESS THAN 

ONE MINUTE 

-3 -2 -1 0 +1 +2 +3 


24. How distracting was the control mechanism? 
NOT MILDLY 

DISTRACTING DISTRACTING 

-3 -2 -1 0 +1 
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27. How proficient in moving and interacting with the virtual environment did you feel at the end 
of the experience? 

NOT REASONABLY VERY 

PROnCIENT PROHCIENT PROFICIENT 

-3 -2 -1 0 +1 +2 +3 

28. How much did the visual display quality interfere or distract you from perfor min g 
assigned tasks or required activities? 

NOT AT ALL INTERFERRED PREVENTED 

SOMEWHAT PERFORMANCE 

-3 -2 -1 0 +1 +2 +3 

29. How much did the control devices interfere with the performance of assigned tasks or 
with other activities? 

NOT AT ALL INTERFERRED INTERFERRED 

SOMEWHAT GREATLY 

-3 -2 -1 0 +1 +2 +3 

30. How well could you concentrate on the assigned tasks or required activities rather 
than on mechanisms used to perform those tasks or activities? 

NOT AT ALL SOMEWHAT COMPLETELY 

-3 -2 -1 0 +1+2 +3 

31. Did you learn new techniques that enabled you to improve your performance? 

NO TECHNIQUES LEARNED SOME LEARNED MANY 

LEARNED TECHNIQUES TECHNIQUES 

-3 -2 -1 0 +1 +2 +3 

32. Were you involved in the experimental task to the extent that you lost track of time? 


NOT AT ALL 


SOMEWHAT 


COMPLETELY 

-3 -2 

-1 

0 +1 

+2 

+3 
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